Time-inconsistent stochastic linear quadratic control for discrete-time systems

Time-Inconsistent Stochastic Linear-Quadratic Control

Abstract. In this paper, we formulate a general time-inconsistent stochastic linear–quadratic (LQ) control problem. The time-inconsistency arises from the presence of a quadratic term of the expected state as well as a state-dependent term in the objective functional. We define an equilibrium, instead of optimal, solution within the class of open-loop controls, and derive a sufficient condition...

Optimal Finite-time Control of Positive Linear Discrete-time Systems

This paper considers solving optimization problem for linear discrete time systems such that closed-loop discrete-time system is positive (i.e., all of its state variables have non-negative values) and also finite-time stable. For this purpose, by considering a quadratic cost function, an optimal controller is designed such that in addition to minimizing the cost function, the positivity proper...

Time-Inconsistent Discrete-Time Stochastic Linear-Quadratic Optimal Control: Time-consistent Solutions

In this paper, the time-consistent solutions of a timeinconsistent discrete-time stochastic linear-quadratic optimal control are investigated. Different from the existing literature, the definiteness constraint is not posed on the state and the control weight matrices of the cost functional. Necessary and sufficient conditions are, respectively, obtained to the existence of the open-loop time-c...

A Robust Control Design Technique for Discrete-Time Systems

A robust state feedback design subject to placement of the closed loop eigenvalues in a prescribed region of unit circle is presented. Quantitative measures of robustness and disturbance rejection are investigated. A stochastic optimization algorithm is used to effect trade-off between the free design parameters and to accomplish all the design criteria. A numerical example is given to illustra...

Stochastic Mixed LQR/H∞ Control for Linear Discrete-Time Systems